An SO (10) Solution to the Puzzle of Quark 
and Lepton Masses * 

K.S.Babu and S.M.Barr 

Bartol Research Institute 
University of Delaware 
Newark, DE 19716 

BA-95-11, |hep-ph/9h(J32T5| 



Abstract 

It is shown that almost all features of the quark and lepton masses 
can be satisfactorily and simply explained without family symmetry, 
including the threefold mass hierarchy among the generations, and 
the relations = m®, mjj = 3m°, m Q e = \m d} m^/m^ <C m d /m^, 
tan# c = y/m d /m° s , V c b <C y/m®/m®, and V u b ~ V c bV us - Various as- 
pects of the group theory of 50(10) play an essential role in explaining 
these relations. The form of the mass matrices, rather than being im- 
posed arbitrarily, emerges naturally from a simple structure at the 
unification scale. This structure involves only vector, spinor and ad- 
joint representations. There are distinctive and testable predictions 
for tan/3 and the neutrino mixing angles. 

*Supported in part by Department of Energy Grant #DE-FG02-91ER406267 
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In this Letter we show that the group theory of SO (10) can provide a 
satisfactory explanation of almost all of the features of the quark and lepton 
masses and mixing angles 1 without family symmetry We propose a model, 
in two versions, each of which has several testable consequences for neutrino 
mixing angles and for the parameter tan /3. 

We propose that the pattern of fermion masses is determined by the 
following Yukawa terms in the superpotential 2 . 

W = M(I6 16) + E-=i ^(16,16)45^ + £? =1 ^(16,16)10* 

(1) 

+ d(10 10')45g° + Ef=i 0,(16,10)16^ + Ef=i cj(16 i 10')16 ff . 

In addition to the three ordinary families of quarks and leptons, which are 
contained in the spinors denoted 16j, there is a pair of spinor and antispinor 
(16,16), and a pair of vectors (10,10'). The Higgs supermultiplets are 
distinguished by the subscript l H\ We will henceforth call the first three 
terms of eq.(l) W sp i nor and the last three terms W vec t or . 

It will be shown that this simple structure explains the following nine 
well-known features of the quark and lepton spectrum. 
The hierarchy: 

(I) The first generation is much lighter than the second and third. 

(II) The second generation is much lighter than the third. 
The mass ratios: 

(III) m' = mj (see Ref. 3). [The superscript refers throughout to quanti- 
ties at the unification scale.] 

(IV) |m°/m°| - 3. 

(V) \m° e /m° d \ 1™°/™°!^ = §• (The Georgi-Jarlskog relations. 4 ) 
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(VI) m°/m° <C m®/m® and m° e /m T . (10 5 versus respectively 10 3 and 
0.3 x KT 3 .) 

The mixing angles: 

(VII) V c b is small compared to y/m®/m%. 

(VIII) tanfl c = v/m^/mO (see Ref. 5). 

(IX) V ub ~ K 6 K S - 

In understanding the structure of eq.(l) a crucial point is that there is no 
Yukawa term Yhj=i /ij(16jl6j)10ff coupling the ordinary families to each 
other 6 , for the coefficient of such a term, fy, would be a matrix in 'family 
space', and one would naturally expect the three eigenvalues of such a matrix 
to be all of the same order rather than to exhibit a hierarchical pattern as 
observed in nature. Instead, what happens in this model is that the families 
(16j) couple to each of the 'extra' fermion multiplets (16, 16, 10, 10') with 
Yukawa couplings that are vectors in family space (a*, b iy Ci, cQ. This leads, 
to first approximation, as will be seen, to a 'factorized' form 7 for the mass 
matrices, ~ afij, which because it has rank less than three does produce 
a hierarchy. 

Another role played by the 'extra' fermions is to allow the 45 H , which 
breaks 50(10), to couple directly to the quarks and leptons as it could not 
renormalizably do were there only the ordinary families, 16j. This is impor- 
tant because some of the predictions of minimal 50(10), such as mJJ = m" 
and mjl/m" = m"/mj, are badly broken in nature. 

We will also discuss a variant of this model which is obtained by adding 
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to the superpotential of eq.(l) the following piece. 



W adjoint = /(45 45')45h + 2X16,45)16* + ^ ^(16,45') 16^. (2) 



i=i 



The structure of this set of terms is quite analogous to W S p inor and W t 



vector ■ 



Here the 'extra' fermions are adjoints (45, 45') which couple, as before, to the 

ordinary families with coefficients which are vectors in family space (ej,ej). 

(x) 

Note that because the Higgs fields 45 H and 45# are antisymmetric tensors, 
the 10 and 10' in W vecior must be distinct, as must the 45 and 45' in W ad j i nt . 

We will denote the mass matrices of the quarks and leptons by U, D, 
L, N, and M R . More precisely, W mass = T,i,j=i[u C LiUijU L j + d c Li Dijd Lj + 
itiLijlij + vltNijVLj + vl^Mnjijvlj]. The dominant contributions to these 
matrices are assumed to come from W sp i nor and have the exact form 8 (up to 
terms of order M W /M GUT ~ 10 



-14\ 



/ 



U = aTv 









Q M sin#/iV, 

V Q u c sin 9/N u c (Q u c + Q u ) cos 6/N u cN u J 



( 



D = aTv' 









Q d sm9/N d 

V Q d c sin 9/N d c (Q d c + Q d ) cos 9/N d cN d J 



(3) 



(4) 



aTv' 



( \ 

Q l -sm9/N l - 

\0 Q l+ sin9/N l+ (Q l+ + Q l -)cos9/N l+ N l - J 





(5) 





An = oTr \ Q v sin9/N u j . (6) 

Q u c sin 9/N u c (Q u c + Q v ) cos 9/N u cN u j 

Here 9 is the angle between the Yukawa coupling constant vectors a, and 6, 
appearing in eq.(l), and a and b are their lengths. Q is an 5*0(10) generator 9 



giving the direction in group space of the vacuum expectation value (VEV) 
of the adjoint Higgs field, 45#, 

(45 H ) = £IQ, (7) 

and Qf is the Q charge of the fermion /. Q, like M, is of order Mqut, so that 
we define a dimensionless ratio bfl/M = T which is of order unity. The Nf are 
defined by Nf = y/1 + T 2 \ Qf\ 2 . (These factors of Nf do not play a significant 
role in what follows. For T < 1 they are close to one. We keep them for the 
sake of exactness.) Finally, v and v' are the usual SU(2) L x ?7(l)y-breaking 
VEVs of the 5(10#) and 5(10//) respectively. (Throughout 'p(q)' denotes a 
p of SU(5) contained in a q of SO (10).) 

The exact forms given in eqs. (3) - (6) can be simply derived by straight- 
forward algebra, but can be more easily understood from Fig. 1. 



16, 



16 



M 
_x 



16 



16, 



t 



t 

(45h> 



Fig. 1 
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By inspection, that diagram gives the expression 

W mass = ]T aA (1 ° H ^ 45if) (16,16,); (8) 

or Wmass = ar(10if)(Ei=iail6i)(Ef=i^<5i6,16j), where Oj = a^/a, 6j = 
For the up quarks this gives 

WZss = aTv £ + a^Q^u* Uj , (9) 

with similar expressions for the down quarks and leptons. Without any loss 
of generality one may choose the axes in family space so that 

Oi = (0, sin 9, cos 9), 

k = (o, o, i), liUj 

which when substituted into eq.(9) and its analogues gives the matrices dis- 
played in eqs.(3) - (6) with Nf — 1. (To build up the factors iVy 1 one must 
sum over all tree graphs with arbitrary numbers of superheavy mass or VEV 
insertions. More simply one can just do the algebra of integrating out the 
16 and 16.) 

Because (45#) cannot break the Standard Model gauge group, Q must 
be a linear combination of the hypercharge and the SU (5)- singlet generator, 
X. (£0(10) D SU(5) x U(l)x-) For convenience Q will be normalized so 
that 

Q = (=±)x + (lz)% = 2 h R + (§e)¥, (11) 

where X is normalized conventionally, so that X 10 (i6) = 1, -^5(16) = — 3, 
^1(16) — 5; and e = z — 1. Thus, for the fermions contained in the 16 of 
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SO(10), 



Qu 
Qi- 



Q d 
Qu c 
Qd c 
Qu 
Qi+ 



1 + l e 
-b 

-i. 



(12) 



We shall assume, for reasons that will become apparent shortly, that Q is 
oriented approximately in the I 3 r direction; that is, that |e| <C 1. Then it is 
seen from their definitions that the Nj for all the left-handed fermions (u, d, 
l~ , v) are very close to one, while for all the left-handed anti-fermions (u c , 



d c , l+, v c ) N f = y/1 + T 2 = N . 

Several striking features 8 of the mass matrices in eqs.(3) - (6) are evident 
upon inspection. 

As a consequence of factorization (cf. eq.(9)) the mass matrices are 
rank 2. This explains (I), the lightness of the first generation. Also ex- 



plained is (III), m 



o ~ 



The origin of this relation is the fact that 



D 33 aTv'(Q d c + Q d )cos9/N = aTv'(Q l+ + Q^cosO/N 9* L 33 . The 
equality of these expressions is no accident, but a consequence of the fact 
that l + l~ and d c d both couple to the same Higgs doublet, 0', and thus 
must have equal charges. On the other hand, eqs.(4) and (5) show that 
\rn°Jm° s \ ^ 1 but rather 

o t r\ r\ i i R r ir. 

(13) 











det 2 3-^ 




Qi+Qi- 


= 3 


1 + 6e/5 










det 23 D 




Qd c Qd 




1 + 2e/5 



Thus the empirical relation (IV), m°/m° = 3 is seen to follow if Q is ap- 
proximately in the I 3 r direction; that is, if |e| <C 1. (Cf. eq.(ll).) 

The I 3 r direction is a natural one for the vacuum expectation value of a 



Higgs field in the adjoint representation of SO (10). For example, 10 the super- 
potential -fitr(A 2 )+\tr(A 4 ), where A is a 45, only has SU(3) x SU(2) x U(l)- 
invariant solutions in the I 3 r, B — L, and X directions. Other interesting 
superpotentials 11 give the same possibilities. As evidence that adjoint Higgs 
might well have potentials of this type, it is significant that the Dimopoulos- 
Wilczek mechanism 12 , which is necessary to solve the 'doublet-triplet split- 
ting problem' in SO(10) requires the existence of an adjoint Higgs whose 
vacuum expectation value is in the B — L direction. 

The assumption that Q is approximately in the I 3 r direction would also 
provide a group-theoretical explanation for two other facts, (II) and (VII). 
(II), that the second generation is much lighter than the third, can be seen 
from eqs.(3) - (6), which reveal that the (2,3) elements of all the matrices 
vanish as e — > 0, causing the matrices to become rank 1. For example, 
wPJml ^ f esin 2 #. That (VII), is small compared to y/m° 8 /m%, follows 
from V° b = tan-^C/aa/C/sa) - tan -1 (D 32 /D 33 ) = §esin#cos#. In the e -> 
limit both V c ° and V® b / y/m®/m b = ^/4e/5iV cos# vanish. It is well-known 
that Fritzsch-type relations 13 for V® b such as |V^| = \^m^/m b — e ta ^m^/m^\ 
fail even though the analogous relation for the Cabibbo angle works well, 
because the observed V® b is about a factor of three too small. Here that 
smallness is explained as due to the smallness of e. 

There is one potentially troubling feature of the forms given in eqs.(3) - 
(6) and that is that in the small e limit the bad 'proportionality' prediction of 
naive SO(10), namely m°/m° = m° s /m b , holds. The violation of this relation 
will be explained in an interesting way below. 

Taking into account the heretofore neglected terms W vector one can show 
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that the exact mass matrices (up to terms of order Mw/Mqut ~ 10 14 ) 
coming from eq.(l) are (using eq.(12)) 

/ \ 

u = u 



aTv 





\tsind/N u 

V -(1 + fe) sine /N uC -(1 + fe) cos9/N u N u c J 



( 



D = aTv'(I+A d c)-2 
( 





Cl2 



-Cl2 





(14) 

-ci3/iV d 



(§esinfl-C2 3 )/% 

V c 13 /N d c ((1 + fe) sin9 + c 23 )/7V d c (1 + fe) cos 9 /N d N d c 



L = aTv' 





-Cl2 

V -ci 3 /iV«+ 



Cl2 





Cia/iVi- 



(15) 



(-fesin6» + c 23 )/iV z - (/+A 



((1 + f e) sm6- c 23 )/N l+ (1 + fe) cos 9/ N l+ N t - 







N = Nr. = aTv 



(16) 
(17) 





-|esin^/^ 

- sin 6/N u c -(1 + |e) cos 9/N v cN v 

One sees that Uq and iVo are unaffected by adding W vec t or and that the 



effect on D and L is to add to them an antisymmetric piece, c^-, and to 
multiply them by mixing matrices (/ + A) - ^. For the moment we will assume 
that these factors can be neglected as would be the case if A d c,A ; - <C 1, 
although such matrices will play an important role in our later discussion. 
(Their exact forms are given by (A^)^- = ^ 16 ^ piPj(c*Cj + c'*c'j) where 
p = (1, 1, A^ 1 ) and the same for Aj- with N d c replaced by iVj-.) The origin 
of the antisymmetric pieces, Cy, can be understood from Fig. 2. 
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16, 



10 d 



10' 



16, 
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(16h) 



\ 

(45g°) 



t 

(16 



Fig. 2 



By inspection of that diagram one sees that W vector contributes 



3 



(1(16„)>(5(16„)> 



AW mass = J2 (cic'j - fa y V f J/ \ x ) ^ 10(16,)5(16 j ). (18) 

The antisymmetry in flavor is due to the antisymmetry of the adjoint of 
50(10). Under the interchange of 10 and 10' in Fig.2 the diagram changes 
sign and ij — > ji. Comparing with eqs.(15) and (16) one obtains Qj = 
(qc' — dcj) — m (H 16 h)) (5(i6 H )) assume that the vacuum expectation 

(X) 

value of the 45 H is in the X direction so that the antisymmetric pieces 
added to D and L are the same. The smallness of the c^- can come from the 
smallness of the Cj or c[, or of their cross product, or of the ratios of vacuum 
expectation values. 

The forms of the full matrices exhibited in eqs.(14) - (17) now explain 
the several further relationships (V), (VI), and (VIII). Relation (V), that 
\m° e /m° d \ = |mgm°/m°m°| = 1/3, is a consequence of det D = detL, which, 



10 



it should be noted, is an exact relation for any values of the parameters both 
in the limit A — > and in the limit Nf — > 1 (which makes A^ c = A/-). 

Relation (VI), that m° is proportionately very tiny compared to m d and 
m°, comes from the fact that W vector contributes only to D and L and leaves 
U rank 2, and thus u massless. Some higher order effects presumably give a 
small mass to u, but as these contributions to U would typically be of order 
lO~ 5 aTv one would expect them to have a negligible effect on everything else 
besides m u . (For example, their contribution to the Cabibbo angle would 
typically be of order m u /m c ~ 0.005.) 

Relation (VIII), tan# c = ^/m d /m Q s is famously successful. 5 In schemes of 
the Fritzsch type 13 there is an extra contribution e^y'mj/mj!, which, being 
of magnitude 0.07 = | tan# c requires that the phase a take a particular value 
to obtain numerical agreement. Here, because W vec t or does not contribute to 
U, one avoids that extra term. 

The foregoing three relations are consequences of the facts that W vec t or 
only contributes to D and L (required for (VI) and (VIII)) and that its 
contribution is antisymmetric (required for (V) and (VIII)). But it should 
be emphasized that these facts in turn are consequences of aspects of SO (10) 
group theory: namely, that the vector representation contains only down 
quarks and leptons, and that the adjoint representation is antisymmetric. 

The final relation, (IX), V u b ~ V c bV us , follows if one makes the natu- 
ral assumption that all the c^- are of the same order, since V u b ~ ci 3 /m°, 
V us ~ Ci2/m,g, and V c b ~ m^/m®. This assumption also would imply that C23 
plays a negligible role. So far, then, there are seven relevant combinations of 
parameters 14 : aTv, v/v', sin#, e, cu, C13, and N. (And for small T, N = 1 

11 



and plays no role.) 

Now comes the question of why (m°/m t °) / '(m°/m°) £ |, when according 
to naive SO (10) and eqs.(3), (4), and (12) it ought to be approximately equal 
to unity. There are two possible simple answers, that m" or m° c is suppressed, 
and they lead to the two versions of the model referred to earlier. The first 
version, where m° is suppressed, has greater economy as it makes do with 
only the terms in eq.(l). In this version the factor (I + A^)^^ which mul- 
tiplies D on the left in eq.(15) is assumed to have the approximate form 
diag(l, 1, 5) where 5 < ±. Then = (Df 2 + D^)* gets multiplied by 5, 
while m° s = -D23-D32/-D33 is left unaffected. While this works, it turns out to 
have some minor drawbacks. The angle 9 ends up being somewhat small, 
and, furthermore, for (I + A^) - ^ to have the desired form the vector q 
(or alternatively c[) must also be nearly aligned with 6j. Such a preferred 
direction in family space is somewhat unappealing since family symmetry 
has been eschewed. A second drawback is that m° = is no longer auto- 
matic but must be fit. Aside from this, this version of the model preserves 
the explanatory successes (I) - (IX) and has in addition several interesting 
predictions. 15 

tan/5 = v/v' = m° c /m° s , 

|0 C „| = v / ^A< + |tan^[ J Re(^ T )/(l + |^ T | 2 )], (19) 
sin 2 26» MT > \. 

Note that since the ratio m°/m° has been affected by the factor (/ + A d c)~^ 
tan/9 is given by the (unaffected) ratio mj/m°, which is quite a distinctive 
prediction. The largeness of 6^ T arises because L32/L33 is no longer = tan6> 
but (a careful calculation shows) = |5 _1 tan^, whereas N 32 /N 33 ~ tan#. 
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We shall now discuss the second and in some ways cleaner version of the 
model, in which is suppressed. We shall see that if the terms W a djoint 
given in eq.(2) are added to the superpotential then the ratio mj!/m ( is typ- 
ically suppressed relative to m^/m® by a factor of 0(e) without any special 
alignment of vectors in family space or special values of parameters. In other 
words, the smallness of m^/mf has a group-theoretical origin. This suppres- 
sion is achieved by a matrix (7 + A. uC )~^ appearing in eq.(14) analogous to 
the matrices appearing in eqs.(15) and (16). 

Since (1(16#)) ^ and is 0(M GUT ), W ad j oint causes the 10(16j) to mix 
with the 10(45) so: 10(45') [/^<2io(45) 10(45) + (l(l6 H ))e / i 10(16 i )], with 
similar mixing of 10(16j) and 10(45') caused by the d term. In particular, 
since the 10(16j) contains the ul there will be produced in eq.(14) a mixing 
matrix (I + A M c)~5 multiplying Uq on the left, with A u c given by 



(A tt c) 



;i(i6*)> 



2 



E*Ei + E'*E' 



(20) 



/f2Qn c (45) 

where E { = p^, E[ = p^, and p { = (1,1, N~}). (Compare with the ex- 
pression for A d c given earlier.) Since the 10(16j) also contains the u iy di, 
and If, there will be analogous mixing matrices (I + A u )~^, (I + A d )~^, 
and (I + A/+)~^ introduced in the obvious places in eqs.(14) - (16), where 
A u , A d , and A/+ are given by eq.(20) with Q« c (45) being replaced by Qu(45), 
Qd(45), and Qi+ (45), respectively, and N u c replaced by the appropriate iV's. 

What is required to suppress m c /m° t is that at least some elements of A. uC 
should be quite large, whereas to preserve the successful relations (I) - (IX) 
the elements of A u , Ad, and A;+ should be somewhat (but not necessarily 
very much) smaller than unity. The required largeness of A u c is explained 
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rather elegantly by group theory The crucial point is that the <3u c (45) ap- 
pearing squared in the denominator of eq.(20) is not the Q charge given in 
eq.(12) of the u\ that is contained in the 16j. Rather, it is the Q charge of the 
u c that are contained in the 45 and 45'. The difference is that X 10 ( 45 ) = —4, 
whereas Xi (i 6 ) = 1, so that by eq.(ll) <5io(45) = Qio(ie) + 1- From eq.(12), 
then, one sees that Q u c (45) = — fe, and therefore A u c oc (^) 2 . The expres- 
sions for A u , Ad, and A ; +, on the other hand, have in their denominators 

<2n(45) = Qd(45) = (! + \ e f and Qf+(45) = ( 2 + f e ) 2 and consequently are not 
enhanced. 

It might be thought that some special form of A u c might have to be as- 
sumed to get a suppression of m°/m°. Curiously, owing to the rank-2 nature 
of A M c, this is not so. Generically, with the elements of A u c = O(^) and given 
by eq.(20), (I + A u c) _ i suppresses m°/m° by a factor 0(e). More precisely, 



if 



E 



E> 



<1(18h)> 



\ExE'\[Ej+E[ 2 ]? 



l(ExE%] 



> 6, then KK)/KK) = fe 
0(e). 

It is assumed that while (1(16#)) is non-zero and superlarge, (5(16#)) 
vanishes. This condition can be naturally achieved 16 and means that W a dj int 
will contribute no antisymmetric piece to U . The only effect, then, of W a dj int 
is the suppression of m^/m®. All the successful relations (I) - (IX) remain 
essentially untouched. In particular, the effect of (/ + A u c) _ 2 on V® h is to 



make V® b = |e sin 9 cos 9 



. This version of the model has 



the following predictions. 

tan/5 ^' = m°K 



^ = ^K + OKK), (21) 
Oer = V ub + O(m u /m° t ). 
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Ofjtr gets a large contribution from L 32 /L 33 = tan 9 ~ 1, and can therefore be 
very large. But for a wide range of the parameters describing Mr, the Ma- 
jorana mass matrix of the right-handed neutrinos, 9^ T = 3V c b (see Ref. (17)) 
due to the near cancellation between L 32 /L 33 and N 32 /N 33 . More precisely, 
for {M R l ) 22 < {M R l ) 23 < {M R l ) 33 , 9, T = 3\/ c6 (l+i[(M i? 1 ) 23 /(M R 1 ) 3 3]iVtan^). 
It should be noted, finally, that in this version of the model, 9 comes out to 
be of order 1, so that there is no unexplained alignment in family space, and e 
comes out of order ^. (This can be seen from the relation m°/m° = ye sin 2 9 
and the relation just given for V® b .) 

In conclusion, we have shown that the group theory of SO( 10) can el- 
egantly explain the pattern of fermion masses and mixing angles without 
family symmetry. We find it remarkable that the nine features listed in 
the introduction can arise as a consequence of the simple Yukawa terms of 
eq.(l). We also find it remarkable that the single group-theoretical assump- 
tion Q ~ I 3 r explains three of those relations as well as the smallness of 
m°/m°. The fact that the gauge group is SO(10) has played several crucial 
roles in the model: it relates the up quarks and neutrinos to the down quarks 
and leptons, it allows the VEVs of the adjoint Higgs fields to point in the 
I 3 r and X directions, and it makes possible the antisymmetric contributions 
to the mass matrices coming from W vec t or - We have only discussed terms 
in the superpotential that are directly relevant to understanding the pattern 
of light fermion masses. Other terms will be present including the Higgs 
sector 12 and additional small Yukawa couplings 18 , but our results are not 
sensitive to these. Details of the numerical fits and certain technical points 
will be presented in a longer paper. 
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